Method and System for Automated Personal Training that Includes Training Programs

ABSTRACT

Systems and methods for creating personalized exercise programs are disclosed. An image capture device and a computer device are used to capture images of a user while the user performs athletic movements. The images may then be evaluated to create a human movement screen score. The human movement screen score, goal and time commitment information may then be used to create a personalized exercise program tailored to the specific user.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.13/304,064, filed Nov. 23, 2011, which is a continuation-in-part of U.S.patent application Ser. No. 13/290,359, filed Nov. 7, 2011, now U.S.Pat. No. 9,283,429, which claims the benefit of, and priority to, U.S.Provisional Patent Application No. 61/410,777 filed Nov. 5, 2010,61/417,102 filed Nov. 24, 2010, 61/422,511 filed Dec. 13, 2010,61/432,472 filed Jan. 13, 2011, and 61/433,792 filed Jan. 18, 2011, eachof which is entitled “Method and System for Automated PersonalTraining.” The content of each of the applications is expresslyincorporated herein by reference in its entirety for any and allnon-limiting purposes.

BACKGROUND

While most people appreciate the importance of physical fitness, manyhave difficulty finding the motivation required to maintain a regularexercise program. Some people find it particularly difficult to maintainan exercise regimen that involves continuously repetitive motions, suchas running, walking and bicycling.

Additionally, individuals may view exercise as work or a chore and thus,separate it from enjoyable aspects of their daily lives. Often, thisseparation between athletic activity and other activities reduces theamount of motivation that an individual might have toward exercising.Further, athletic activity services and systems directed towardencouraging individuals to engage in athletic activities might also betoo focused on one or more particular activities while an individual'sinterests are ignored. This may further decrease a user's interest inparticipating in athletic activities or using the athletic activityservices and systems.

Therefore, improved systems and methods to address these and othershortcomings in the art are desired.

BRIEF SUMMARY

The following presents a simplified summary in order to provide a basicunderstanding of some aspects of the disclosure. The summary is not anextensive overview of the disclosure. It is neither intended to identifykey or critical elements of the disclosure nor to delineate the scope ofthe disclosure. The following summary merely presents some concepts ofthe disclosure in a simplified form as a prelude to the descriptionbelow.

Aspects of the invention provide systems and methods for creatingpersonalized exercise programs. A computer device, such as a video gameconsole may be used with an image capture device, such as a group ofcameras to capture images of a user performing athletic movements. Asused herein, an “athletic movement” includes movements relating tofitness, exercise, flexibility, including movements that may be part ofone or more single and multiple participant athletic competitions,exercise routines, and/or combinations thereof. The images may then beevaluated to create a human movement screen score. The human movementscreen score may be used to create a personalized exercise programtailored to the specific user. A human movement screen (HMS) is aranking and grading system that documents movement patterns that may bekey to normal function. The functional movement screen (FMS) developedby Gray Cook is an example of a human movement screen.

In some embodiments the user may also provide preference data, such asdata relating to time commitments, preferred exercises and a preferrednumber of exercise sessions in a predetermined time period. The computerdevice may consider these factors when creating a personalized exerciseprogram.

Certain other embodiments may capture athletic movement data withaccelerometers, gyroscopes or position locating devices, such as GPSdevices.

In other embodiments, the present invention can be partially or whollyimplemented on a tangible non-transitory computer-readable medium, forexample, by storing computer-executable instructions or modules, or byutilizing computer-readable data structures.

Of course, the methods and systems of the above-referenced embodimentsmay also include other additional elements, steps, computer-executableinstructions, or computer-readable data structures.

These and other aspects of the embodiments are discussed in greaterdetail throughout this disclosure, including the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

The present disclosure is illustrated by way of example and not limitedin the accompanying figures in which like reference numerals indicatesimilar elements and in which:

FIGS. 1A-B illustrate an example of a system for providing personaltraining in accordance with example embodiments, wherein FIG. 1Aillustrates an example network configured to monitor athletic activity,and FIG. 1B illustrates an example computing device in accordance withexample embodiments.

FIGS. 2A-B illustrate example sensor assemblies that may be worn by auser in accordance with example embodiments.

FIG. 3 illustrates example points on a user's body to monitor inaccordance with example embodiments.

FIG. 4 illustrates an example posture assessment in accordance withexample embodiments.

FIG. 5 illustrates an exemplary method that may be used to generatepersonalized training programs in accordance with an embodiment of theinvention

FIG. 6 shows exemplary instructions that may be provided to a user toperform the athletic movement.

FIG. 7 illustrates exemplary personalized exercise program phases inaccordance with an embodiment of the invention.

FIG. 8 illustrates another example flow diagram for a user's initialinteraction to determine a user's baseline physical fitness level.

FIG. 9 illustrates an example flow diagram creating a personalizedexercise program

FIG. 10 illustrates an example graphical user interface with options toselect a trainer, to start a new program, or to do a drop-in workoutsession.

FIG. 11 illustrates an example graphical user interface prompting a userto input user desired workout selections.

FIG. 12 illustrates an example graphical user interface that includes ascroll bar permitting a user to select a desired number of times toexercise per week.

FIG. 13 illustrates an example graphical user interface permitting auser to input reminders so that an email or text message may be sent toa device (e.g., mobile phone) to remind the user about an upcomingworkout session.

FIG. 14 illustrates an example initial baseline physical fitness levelbased on human movement screen scoring and tempo.

FIG. 15 illustrates example drills for assessing user performancerelative to performance pillars and body movement categories.

FIG. 16 illustrates an example relationship between body movementcategories and human movement screen exercises.

FIG. 17 provides an example of different tempos at which a same drillcan be performed.

FIG. 18 illustrates an example workout structure.

FIG. 19 illustrates an example flow diagram for setting goals andencouraging commitment from a user.

FIG. 20-34 illustrates an example six month workout plan that mayinclude a baseline workout and six month long programs.

FIG. 35 illustrates an example 4 week routine to aid a user in achievinga goal.

FIG. 36 illustrates an example leading a user through a workout session.

FIG. 37 illustrates an example graphical user interface prompting a userto begin a workout session, and asking how long the user has to workout.

FIG. 38 illustrates an example graphical user interface leading a userthrough a warm up session.

FIG. 39 illustrates an example graphical user interface providing ademonstration of a first exercise drill.

FIG. 40 illustrates an example graphical user interface displaying animage of the user performing a drill.

FIG. 41 illustrates an example graphical user interface comparing auser's form versus desired form.

FIG. 42 illustrates an example graphical user interface including animage of a user exercising with added straight lines to show proper backand hip posture during a deep squat.

FIGS. 43A-B illustrate example graphical user interfaces providing auser with feedback on their form and removing the corrective feedbackwhen the user's form improves.

FIG. 44 illustrates an example graphical user interface informing a userof a next training category during the workout session.

FIG. 45 illustrates example data points used by a computer to determinefeedback and motivation to provide to a user during a workout session.

FIGS. 46-49 illustrate examples of revising a workout session based onthe amount of time a user can commit to a workout.

FIG. 50 illustrates an example flow diagram for providing a user withpost-workout information.

FIG. 51 illustrates an example graphical user interface informing a userthat a workout session is complete.

FIG. 52-53 illustrates example graphical user interfaces informing auser of their workout performance and an amount of points they havereceived during the workout.

FIG. 54 illustrates an example graphical user interface prompting a userto continue exercising.

FIG. 55 illustrates an example flow diagram of a drop-in workoutsession.

FIG. 56 illustrates an example graphical user interface permitting auser to select a drop-in workout session.

FIG. 57 illustrates an example graphical user interface prompting a userto input how long they have to work out during a drop-in session.

FIG. 58 illustrates an example graphical user interface prompting a userto input what type of session they want to do during a drop-in session.

FIG. 59 illustrates an example graphical user interface of an imagecaptured of a user working out during a drop-in session.

FIG. 60 illustrates an exemplary challenge drill.

DETAILED DESCRIPTION

In the following description of the various embodiments, reference ismade to the accompanying drawings, which form a part hereof, and inwhich is shown by way of illustration various embodiments in which thedisclosure may be practiced. It is to be understood that otherembodiments may be utilized and structural and functional modificationsmay be made without departing from the scope and spirit of the presentdisclosure. Further, headings within this disclosure should not beconsidered as limiting aspects of the disclosure. Those skilled in theart with the benefit of this disclosure will appreciate that the exampleembodiments are not limited to the example headings.

I. Example Personal Training System A. Illustrative Computing Devices

FIG. 1A illustrates an example of a personal training system 100 inaccordance with example embodiments. Example system 100 may include oneor more electronic devices, such as computer 102. Computer 102 maycomprise a mobile terminal, such as a telephone, music player, tablet,netbook or any portable device. In other embodiments, computer 102 maycomprise a set-top box (STB), desktop computer, digital videorecorder(s) (DVR), computer server(s), and/or any other desiredcomputing device. In certain configurations, computer 102 may comprise agaming console, such as for example, a Microsoft® XBOX, Sony®Playstation, and/or a Nintendo® Wii gaming consoles. Those skilled inthe art will appreciate that these are merely example consoles fordescriptive purposes and this disclosure is not limited to any consoleor device.

Turning briefly to FIG. 1B, computer 102 may include computing unit 104,which may comprise at least one processing unit 106. Processing unit 106may be any type of processing device for executing softwareinstructions, such as for example, a microprocessor device. Computer 102may include a variety of non-transitory computer readable media, such asmemory 108. Memory 108 may include, but is not limited to, random accessmemory (RAM) such as RAM 110, and/or read only memory (ROM), such as ROM112. Memory 108 may include any of: electronically erasable programmableread only memory (EEPROM), flash memory or other memory technology,CD-ROM, digital versatile disks (DVD) or other optical disk storage,magnetic storage devices, or any other medium that can be used to storethe desired information and that can be accessed by computer 102.

The processing unit 106 and the system memory 108 may be connected,either directly or indirectly, through a bus 114 or alternatecommunication structure to one or more peripheral devices. For example,the processing unit 106 or the system memory 108 may be directly orindirectly connected to additional memory storage, such as a hard diskdrive 116, a removable magnetic disk drive, an optical disk drive 118,and a flash memory card, as well as to input devices 120, and outputdevices 122. The processing unit 106 and the system memory 108 also maybe directly or indirectly connected to one or more input devices 120 andone or more output devices 122. The output devices 122 may include, forexample, a display device 136, television, printer, stereo, or speakers.In some embodiments one or more display devices may be incorporated intoeyewear. The display devices incorporated into eyewear may providefeedback to users. Eyewear incorporating one or more display devicesalso provides for a portable display system. The input devices 120 mayinclude, for example, a keyboard, touch screen, a remote control pad, apointing device (such as a mouse, touchpad, stylus, trackball, orjoystick), a scanner, a camera or a microphone. In this regard, inputdevices 120 may comprise one or more sensors configured to sense,detect, and/or measure athletic movement from a user, such as user 124,shown in FIG. 1A.

Looking again to FIG. 1A, image-capturing device 126 and/or sensor 128may be utilized in detecting and/or measuring athletic movements of user124. In one embodiment, data obtained image-capturing device 126 orsensor 128 may directly detect athletic movements, such that the dataobtained from image-capturing device 126 or sensor 128 is directlycorrelated to a motion parameter. For example, and with reference toFIG. 4, image data from image-capturing device 126 may detect that thedistance between sensor locations 402 g and 402 i has decreased andtherefore, image-capturing device 126 alone may be configured to detectthat user's 124 right arm has moved. Yet, in other embodiments, datafrom image-capturing device 126 and/or sensor 128 may be utilized incombination, either with each other or with other sensors to detectand/or measure movements. Thus, certain measurements may be determinedfrom combining data obtained from two or more devices. Image-capturingdevice 126 and/or sensor 128 may include or be operatively connected toone or more sensors, including but not limited to: an accelerometer, agyroscope, a location-determining device (e.g., GPS), light sensor,temperature sensor (including ambient temperature and/or bodytemperature), heart rate monitor, image-capturing sensor, moisturesensor and/or combinations thereof. Example uses of illustrative sensors126, 128 are provided below in Section I.C, entitled “IllustrativeSensors.” Computer 102 may also use touch screens or image capturingdevice to determine where a user is pointing to make selections from agraphical user interface. One or more embodiments may utilize one ormore wired and/or wireless technologies, alone or in combination,wherein examples of wireless technologies include Bluetooth®technologies, Bluetooth® low energy technologies, and/or ANTtechnologies.

B. Illustrative Network

Still further, computer 102, computing unit 104, and/or any otherelectronic devices may be directly or indirectly connected to one ormore network interfaces, such as example interface 130 (shown in FIG.1B) for communicating with a network, such as network 132. In theexample of FIG. 1B, network interface 130, may comprise a networkadapter or network interface card (NIC) configured to translate data andcontrol signals from the computing unit 104 into network messagesaccording to one or more communication protocols, such as theTransmission Control Protocol (TCP), the Internet Protocol (IP), and theUser Datagram Protocol (UDP). These protocols are well known in the art,and thus will not be discussed here in more detail. An interface 130 mayemploy any suitable connection agent for connecting to a network,including, for example, a wireless transceiver, a power line adapter, amodem, or an Ethernet connection. Network 132, however, may be any oneor more information distribution network(s), of any type(s) ortopography(s), alone or in combination(s), such as internet(s),intranet(s), cloud(s), LAN(s). Network 132 may be any one or more ofcable, fiber, satellite, telephone, cellular, wireless, etc. Networksare well known in the art, and thus will not be discussed here in moredetail. Network 132 may be variously configured such as having one ormore wired or wireless communication channels to connect one or morelocations (e.g., schools, businesses, homes, consumer dwellings, networkresources, etc.), to one or more remote servers 134, or to othercomputers, such as similar or identical to computer 102. Indeed, system100 may include more than one instance of each component (e.g., morethan one computer 102, more than one display 136, etc.).

Regardless of whether computer 102 or other electronic device withinnetwork 132 is portable or at a fixed location, it should be appreciatedthat, in addition to the input, output and storage peripheral devicesspecifically listed above, the computing device may be connected, suchas either directly, or through network 132 to a variety of otherperipheral devices, including some that may perform input, output andstorage functions, or some combination thereof. In certain embodiments,a single device may integrate one or more components shown in FIG. 1A.For example, a single device may include computer 102, image-capturingdevice 126, sensor 128, display 136 and/or additional components. In oneembodiment, sensor device 138 may comprise a mobile terminal having adisplay 136, image-capturing device 126, and one or more sensors 128.Yet, in another embodiment, image-capturing device 126, and/or sensor128 may be peripherals configured to be operatively connected to a mediadevice, including for example, a gaming or media system. Thus, it goesfrom the foregoing that this disclosure is not limited to stationarysystems and methods. Rather, certain embodiments may be carried out by auser 124 in almost any location.

C. Illustrative Sensors

Computer 102 and/or other devices may comprise one or more sensors 126,128 configured to detect and/or monitor at least one fitness parameterof a user 124. Sensors 126 and/or 128, may include but not limited to:an accelerometer, a gyroscope, a location-determining device (e.g.,GPS), light sensor, temperature sensor (including ambient temperatureand/or body temperature), sleep pattern sensors, heart rate monitor,image-capturing sensor, moisture sensor and/or combinations thereof.Network 132 and/or computer 102 may be in communication with one or moreelectronic devices of system 100, including for example, display 136, animage capturing device 126 (e.g., one or more video cameras), and sensor128, which may be an infrared (IR) device. In one embodiment sensor 128may comprise an IR transceiver. For example, sensors 126, and/or 128 maytransmit waveforms into the environment, including towards the directionof user 124 and receive a “reflection” or otherwise detect alterationsof those released waveforms. In yet another embodiment, image-capturingdevice 126 and/or sensor 128 may be configured to transmit and/orreceive other wireless signals, such as radar, sonar, and/or audibleinformation. Those skilled in the art will readily appreciate thatsignals corresponding to a multitude of different data spectrums may beutilized in accordance with various embodiments. In this regard, sensors126 and/or 128 may detect waveforms emitted from external sources (e.g.,not system 100). For example, sensors 126 and/or 128 may detect heatbeing emitted from user 124 and/or the surrounding environment. Thus,image-capturing device 126 and/or sensor 128 may comprise one or morethermal imaging devices. In one embodiment, image-capturing device 126and/or sensor 128 may comprise an IR device configured to perform rangephenomenology. As a non-limited example, image-capturing devicesconfigured to perform range phenomenology are commercially availablefrom Flir Systems, Inc. of Portland, Oreg. Although image capturingdevice 126 and sensor 128 and display 136 are shown in direct(wirelessly or wired) communication with computer 102, those skilled inthe art will appreciate that any may directly communicate (wirelessly orwired) with network 132.

1. Multi-Purpose Electronic Devices

User 124 may possess, carry, and/or wear any number of electronicdevices, including sensory devices 138, 140, 142, and/or 144. In certainembodiments, one or more devices 138, 140, 142, 144 may not be speciallymanufactured for fitness or athletic purposes. Indeed, aspects of thisdisclosure relate to utilizing data from a plurality of devices, some ofwhich are not fitness devices, to collect, detect, and/or measureathletic data. In one embodiment, device 138 may comprise a portableelectronic device, such as a telephone or digital music player,including an IPOD®, IPAD®, or iPhone®, brand devices available fromApple, Inc. of Cupertino, Calif. or Zune® or Microsoft® Windows devicesavailable from Microsoft of Redmond, Wash. As known in the art, digitalmedia players can serve as both an output device for a computer (e.g.,outputting music from a sound file or pictures from an image file) and astorage device. In one embodiment, device 138 may be computer 102, yetin other embodiments, computer 102 may be entirely distinct from device138. Regardless of whether device 138 is configured to provide certainoutput, it may serve as an input device for receiving sensoryinformation. Devices 138, 140, 142, and/or 144 may include one or moresensors, including but not limited to: an accelerometer, a gyroscope, alocation-determining device (e.g., GPS), light sensor, temperaturesensor (including ambient temperature and/or body temperature), heartrate monitor, image-capturing sensor, moisture sensor and/orcombinations thereof. In certain embodiments, sensors may be passive,such as reflective materials that may be detected by image-capturingdevice 126 and/or sensor 128 (among others). In certain embodiments,sensors 144 may be integrated into apparel, such as athletic clothing.For instance, the user 124 may wear one or more on-body sensors 144 a-b.Sensors 144 may be incorporated into the clothing of user 124 and/orplaced at any desired location of the body of user 124. Sensors 144 maycommunicate (e.g., wirelessly) with computer 102, sensors 128, 138, 140,and 142, and/or camera 126. Examples of interactive gaming apparel aredescribed in U.S. patent application Ser. No. 10/286,396, filed Oct. 30,2002, and published as U.S. Pat. Pub, No. 2004/0087366, the contents ofwhich are incorporated herein by reference in its entirety for any andall non-limiting purposes. In certain embodiments, passive sensingsurfaces may reflect waveforms, such as infrared light, emitted byimage-capturing device 126 and/or sensor 128. In one embodiment, passivesensors located on user's 124 apparel may comprise generally sphericalstructures made of glass or other transparent or translucent surfaceswhich may reflect waveforms. Different classes of apparel may beutilized in which a given class of apparel has specific sensorsconfigured to be located proximate to a specific portion of the user's124 body when properly worn. For example, golf apparel may include oneor more sensors positioned on the apparel in a first configuration andyet soccer apparel may include one or more sensors positioned on apparelin a second configuration.

Devices 138-144 may communicate with each other, either directly orthrough a network, such as network 132. Communication between one ormore of devices 138-144 may communicate through computer 102. Forexample, two or more of devices 138-144 may be peripherals operativelyconnected to bus 114 of computer 102. In yet another embodiment, a firstdevice, such as device 138 may communicate with a first computer, suchas computer 102 as well as another device, such as device 142, however,device 142 may not be configured to connect to computer 102 but maycommunicate with device 138. Those skilled in the art will appreciatethat other configurations are possible.

Some implementations of the example embodiments may alternately oradditionally employ computing devices that are intended to be capable ofa wide variety of functions, such as a desktop or laptop personalcomputer. These computing devices may have any combination of peripheraldevices or additional components as desired. Also, the components shownin FIG. 1B may be included in the server 134, other computers,apparatuses, etc.

2. Illustrative Apparel/Accessory Sensors

In certain embodiments, sensory devices 138, 140, 142 and/or 144 may beformed within or otherwise associated with user's 124 clothing oraccessories, including a watch, armband, wristband, necklace, shirt,shoe, or the like. Examples of shoe-mounted and wrist-worn devices(devices 140 and 142, respectively) are described immediately below,however, these are merely example embodiments and this disclosure shouldnot be limited to such.

i. Shoe-Mounted Device

In certain embodiments, sensory device 140 may comprise footwear whichmay include one or more sensors, including but not limited to: anaccelerometer, location-sensing components, such as GPS, and/or a forcesensor system. FIG. 2A illustrates one exemplary embodiment of anexample sensor system 202. In certain embodiments, system 202 mayinclude a sensor assembly 204. Assembly 204 may comprise one or moresensors, such as for example, an accelerometer, location-determiningcomponents, and/or force sensors. In the illustrated embodiment,assembly 204 incorporates a plurality of sensors, which may includeforce-sensitive resistor (FSR) sensors 206. In yet other embodiments,other sensor(s) may be utilized. Port 208 may be positioned within asole structure 209 of a shoe. Port 208 may optionally be provided to bein communication with an electronic module 210 (which maybe in a housing211) and a plurality of leads 212 connecting the FSR sensors 206 to theport 208. Module 210 may be contained within a well or cavity in a solestructure of a shoe. The port 208 and the module 210 includecomplementary interfaces 214, 216 for connection and communication.

In certain embodiments, at least one force-sensitive resistor 206 shownin FIG. 2A may contain first and second electrodes or electricalcontacts 218, 220 and a force-sensitive resistive material 222 and/or224 disposed between the electrodes 218, 220 to electrically connect theelectrodes 218, 220 together. When pressure is applied to theforce-sensitive material 222/224, the resistivity and/or conductivity ofthe force-sensitive material 222/224 changes, which changes theelectrical potential between the electrodes 218, 220. The change inresistance can be detected by the sensor system 202 to detect the forceapplied on the sensor 216. The force-sensitive resistive material222/224 may change its resistance under pressure in a variety of ways.For example, the force-sensitive material 222/224 may have an internalresistance that decreases when the material is compressed, similar tothe quantum tunneling composites described in greater detail below.Further compression of this material may further decrease theresistance, allowing quantitative measurements, as well as binary(on/off) measurements. In some circumstances, this type offorce-sensitive resistive behavior may be described as “volume-basedresistance,” and materials exhibiting this behavior may be referred toas “smart materials.” As another example, the material 222/224 maychange the resistance by changing the degree of surface-to-surfacecontact. This can be achieved in several ways, such as by usingmicroprojections on the surface that raise the surface resistance in anuncompressed condition, where the surface resistance decreases when themicroprojections are compressed, or by using a flexible electrode thatcan be deformed to create increased surface-to-surface contact withanother electrode. This surface resistance may be the resistance betweenthe material 222 and the electrode 218, 220 and/or the surfaceresistance between a conducting layer (e.g. carbon/graphite) and aforce-sensitive layer (e.g. a semiconductor) of a multi-layer material222/224. The greater the compression, the greater the surface-to-surfacecontact, resulting in lower resistance and enabling quantitativemeasurement. In some circumstances, this type of force-sensitiveresistive behavior may be described as “contact-based resistance.” It isunderstood that the force-sensitive resistive material 222/224, asdefined herein, may be or include a doped or non-doped semiconductingmaterial.

The electrodes 218, 220 of the FSR sensor 206 can be formed of anyconductive material, including metals, carbon/graphite fibers orcomposites, other conductive composites, conductive polymers or polymerscontaining a conductive material, conductive ceramics, dopedsemiconductors, or any other conductive material. The leads 212 can beconnected to the electrodes 218, 220 by any suitable method, includingwelding, soldering, brazing, adhesively joining, fasteners, or any otherintegral or non-integral joining method. Alternately, the electrode 218,220 and associated lead(s) 212 may be formed of a single piece of thesame material 222/224. In further embodiments, material 222 isconfigured to have at least one electric property (e.g., conductivity,resistance, etc.) than material 224. Examples of exemplary sensors aredisclosed in U.S. patent application Ser. No. 12/483,824, filed on Jun.12, 2009, the contents of which are incorporated herein in theirentirety for any and all non-limiting purposes.

ii. Wrist-Worn Device

As shown in FIG. 2B, device 226 (which may be, or be a duplicative of orresemble sensory device 142 shown in FIG. 1A) may be configured to beworn by user 124, such as around a wrist, arm, ankle or the like. Device226 may monitor movements of a user, including, e.g., athletic movementsor other activity of user 124. For example, in one embodiment, device226 may be activity monitor that measures, monitors, tracks or otherwisesenses the user's activity (or inactivity) regardless of the user'sproximity or interactions with computer 102. Device 226 may detectathletic movement or other activity (or inactivity) during user's 124interactions with computer 102 and/or operate independently of computer102. Device 226 may communicate directly or indirectly, wired orwirelessly, with network 132 and/or other devices, such as devices 138and/or 140. Athletic data obtained from device 226 may be utilized indeterminations conducted by computer 102, such as determinationsrelating to which exercise programs are presented to user 124. As usedherein, athletic data means data regarding or relating to a user'sactivity (or inactivity). In one embodiment, device 226 may wirelesslyinteract with a remote website such as a site dedicated to fitness orhealth related subject matter, either directly or indirectly (e.g., viaa mobile device, such as device 138 associated with user 124). In thisor another embodiment, device 226 may interact with a mobile device,such as device 138, as to an application dedicated to fitness or healthrelated subject matter. In these or other embodiments, device 226 mayinterest with both a mobile device as to an application as above, suchas device 138, and a remote website, such as a site dedicated to fitnessor health related subject matter, either directly or indirectly (e.g.,via the mobile device, such as device 138). In some embodiments, at somepredetermined time(s), the user may wish to transfer data from thedevice 226 to another location. For example, a user may wish to uploaddata from a portable device with a relatively smaller memory to a largerdevice with a larger quantity of memory. Communication between device226 and other devices may be done wirelessly and/or through wiredmechanisms.

As shown in FIG. 2B, device 226 may include an input mechanism, such asa button 228, to assist in operation of the device 226. The button 228may be a depressible input operably connected to a controller 230 and/orany other electronic components, such as one or more elements of thetype(s) discussed in relation to computer 102 shown in FIG. 1B.Controller 230 may be embedded or otherwise part of housing 232. Housing232 may be formed of one or more materials, including elastomericcomponents and comprise one or more displays, such as display 234. Thedisplay may be considered an illuminable portion of the device 226. Thedisplay 234 may include a series of individual lighting elements orlight members such as LED lights 234 in an exemplary embodiment. The LEDlights may be formed in an array and operably connected to thecontroller 230. Device 226 may include an indicator system 236, whichmay also be considered a portion or component of the overall display234. It is understood that the indicator system 236 can operate andilluminate in conjunction with the display 234 (which may have pixelmember 235) or completely separate from the display 234. The indicatorsystem 236 may also include a plurality of additional lighting elementsor light members 238, which may also take the form of LED lights in anexemplary embodiment. In certain embodiments, indicator system 236 mayprovide a visual indication of goals, such as by illuminating a portionof lighting members 238 to represent accomplishment towards one or moregoals.

A fastening mechanism 240 can be unlatched wherein the device 226 can bepositioned around a wrist of the user 124 and the fastening mechanism240 can be subsequently placed in a latched position. The user can wearthe device 226 at all times if desired. In one embodiment, fasteningmechanism 240 may comprise an interface, including but not limited to aUSB port, for operative interaction with computer 102 and/or devices138, 140, and/or recharging an internal power source.

In certain embodiments, device 226 may comprise a sensor assembly (notshown in FIG. 2B). The sensor assembly may comprise a plurality ofdifferent sensors. In an example embodiment, the sensor assembly maycomprise or permit operative connection to an accelerometer (includingin the form of a multi-axis accelerometer), a gyroscope, alocation-determining device (e.g., GPS), light sensor, temperaturesensor (including ambient temperature and/or body temperature), heartrate monitor, image-capturing sensor, moisture sensor and/orcombinations thereof. Detected movements or parameters from device's 142sensor(s), may include (or be used to form) a variety of differentparameters, metrics or physiological characteristics including but notlimited to speed, distance, steps taken, and energy expenditure such ascalories, heart rate and sweat detection. Such parameters may also beexpressed in terms of activity points or currency earned by the userbased on the activity of the user. Examples of wrist-worn sensors thatmay be utilized in accordance with various embodiments are disclosed inU.S. patent application Ser. No. 13/287,064, filed on Nov. 1, 2011, thecontents of which are incorporated herein in their entirety for any andall non-limiting purposes.

iii. Identify Sensory Locations

The system 100 may process sensory data to identify user movement data.In one embodiment, sensory locations may be identified. For example,images of recorded video, such as from image-capturing device 126, maybe utilized in an identification of user movement. For example, the usermay stand a certain distance, which may or may not be predefined, fromthe image-capturing device 126, and computer 102 may process the imagesto identify the user 124 within the video, for example, using disparitymapping techniques. In an example, the image capturing device 126 may bea stereo camera having two or more lenses that are spatially offset fromone another and that simultaneously capture two or more images of theuser. Computer 102 may process the two or more images taken at a sametime instant to generate a disparity map for determining a location ofcertain parts of the user's body in each image (or at least some of theimages) in the video using a coordinate system (e.g., Cartesiancoordinates). The disparity map may indicate a difference between animage taken by each of the offset lenses.

In a second example, one or more sensors may be located on or proximateto the user's 124 body at various locations or wear a suit havingsensors situated at various locations. Yet, in other embodiments, sensorlocations may be determined from other sensory devices, such as devices138, 140, 142 and/or 144. With reference to FIG. 3, sensors may beplaced (or associated with, such as with image-capturing device 126)body movement regions, such as joints (e.g., ankles, elbows, shoulders,etc.) or at other locations of interest on the user's 124 body. Examplesensory locations are denoted in FIG. 3 by locations 302 a-302 o. Inthis regard, sensors may be physical sensors located on/in a user'sclothing, yet in other embodiments, sensor locations 302 a-302 o may bebased upon identification of relationships between two moving bodyparts. For example, sensor location 302 a may be determined byidentifying motions of user 124 with an image-capturing device, such asimage-capturing device 126. Thus, in certain embodiments, a sensor maynot physically be located at a specific location (such as sensorlocations 302 a-302 o), but is configured to sense properties of thatlocation, such as with image-capturing device 126. In this regard, theoverall shape or portion of a user's body may permit identification ofcertain body parts. Regardless of whether an image-capturing device,such as camera 126, is utilized and/or a physical sensor located on theuser 124, such as sensors within or separate from one or more ofdevice(s) 138, 140, 142, 144 are utilized, the sensors may sense acurrent location of a body part and/or track movement of the body part.In one embodiment, location 302 m may be utilized in a determination ofthe user's center of gravity (a.k.a, center of mass). For example,relationships between location 302 a and location(s) 302 f/3021 withrespect to one or more of location(s) 302 m-302 o may be utilized todetermine if a user's center of gravity has been elevated along thevertical axis (such as during a jump) or if a user is attempting to“fake” a jump by bending and flexing their knees. In one embodiment,sensor location 302 n may be located at about the sternum of user 124.Likewise, sensor location 302 o may be located approximate to the navalof user 124. In certain embodiments, data from sensor locations 302m-302 o may be utilized (alone or in combination with other data) todetermine the center of gravity for user 124. In further embodiments,relationships between multiple several sensor locations, such as sensors302 m-302 o, may be utilized in determining orientation of the user 124and/or rotational forces, such as twisting of user's 124 torso. Further,one or more locations, such as location(s), may be utilized to as acenter of moment location. For example, in one embodiment, one or moreof location(s) 302 m-302 o may serve as a point for a center of momentlocation of user 124. In another embodiment, one or more locations mayserve as a center of moment of specific body parts or regions.

In certain embodiments, a time stamp to the data collected indicating aspecific time when a body part was at a certain location. Sensor datamay be received at computer 102 (or other device) via wireless or wiredtransmission. A computer, such as computer 102 and/or devices 138, 140,142, 144 may process the time stamps to determine the locations of thebody parts using a coordinate system (e.g., Cartesian coordinates)within each (or at least some) of the images in the video. Data receivedfrom image-capturing device 126 may be corrected, modified, and/orcombined with data received from one or more other devices 138, 140, 142and 144.

In a third example, computer 102 may use infrared pattern recognition todetect user movement and locations of body parts of the user 124. Forexample, the sensor 128 may include an infrared transceiver, which maybe part of image-capturing device 126, or another device, that may emitan infrared signal to illuminate the user's 124 body using infraredsignals. The infrared transceiver 128 may capture a reflection of theinfrared signal from the body of user 124. Based on the reflection,computer 102 may identify a location of certain parts of the user's bodyusing a coordinate system (e.g., Cartesian coordinates) at particularinstances in time. Which and how body parts are identified may bepredetermined based on a type of exercise a user is requested toperform.

As part of a workout routine, computer 102 may make an initial posturalassessment of the user 124 as part of the initial user assessment. Withreference to FIG. 4, computer 102 may analyze front and side images of auser 124 to determine a location of one or more of a user's shoulders,upper back, lower back, hips, knees, and ankles. On-body sensors and/orinfrared techniques may also be used, either alone or in conjunctionwith image-capturing device 126, to determine the locations of variousbody parts for the postural assessment. For example, computer 102 maydetermine assessment lines 124 a-g to determine the locations of avarious points on a user's body, such as, for example, ankles, knees,hips, upper back, lower back, and shoulders.

3. Identify Sensory Regions

In further embodiments, system 100 may identify sensor regions. In oneembodiment, assessments lines 144 a-g may be utilized to divide theuser's body into regions. For example, lines 144 b-f may be horizontalaxes. For example, a “shoulders” region 402 may correlate to a bodyportion having a lower boundary around the user's shoulders (see line144 b), region 404 may correlate to the body portion between theshoulders (line 144 b) and about half the distance to the hips (see line144 c) and thus be an “upper back” region, and region 406 may span thearea between line 144 c to the hips (see line 144 d) to comprise a“lower back region.” Similarly, region 408 may span the area between the“hips” (line 144 d) and the “knees” (see line 144 e), region 410 mayspan between lines 144 e and 144 f and region 412 (see “ankles”) mayhave an upper boundary around line 144 f. Regions 402-412 may be furtherdivided, such as into quadrants, such as by using axes 144 a and 144 g

4. Categorize Locations or Regions

Regardless of whether specific points (e.g., locations shown in FIG. 3)and/or regions (e.g. regions shown in FIG. 4), body parts or regionsthat are not proximate to each other may nonetheless be categorized intothe same movement category (see, e.g. block 302 c). For example, asshown in FIG. 4, the “upper back”, “hips”, and “ankles” regions 404,408,412 may be categorized as belonging to a “mobility” category. Inanother embodiment, the “lower back” and “knees” regions 406, 410 may becategorized as belonging to a “stability” category. The categorizationsare merely examples, and in other embodiments, a location or region maybelong to multiple categories. For example, a “center of gravity” regionmay be formed from regions 404 and 406. In one embodiment, a “center ofgravity” may comprise portions of regions 404 and 406. IN anotherembodiment, a “center of moment” category may be provided, eitherindependently, or alternatively, as comprising a portion of at leastanother category. In one embodiment, a single location may be weightedin two or more categories, such as being 10% weighted in a “stability”category and 90% weighted in a “mobility” category.

Computer 102 may also process the image to determine a color of clothingof the user or other distinguishing features to differentiate the userfrom their surroundings. After processing, computer 102 may identify alocation of multiple points on the user's body and track locations ofthose points, such as locations 302 in FIG. 3. Computer 102 may alsoprompt the user to answer questions to supplement the posturalassessment, such as, for example, age, weight, etc.

II. Creation of Personal Training Programs A. Overview

FIG. 5 illustrates an exemplary method that may be used to generatepersonalized training programs in accordance with an embodiment of theinvention. First, in step 502, instructions to perform athleticmovements are provided. The instructions may be generated at a videogame console and displayed on a display device, such as a television.Exemplary instructions to perform athletic movements are described indetail below. The athletic movements may be used to generate a humanmovement screen score. The movements may each map to a specific bodymovement. In one embodiment, the athletic movements include deep squat,hurdle step, in-line lunge, shoulder mobility, active leg raise, push upand rotary stability. FIG. 6 show exemplary instructions that may beprovided to a user to perform the athletic movements.

Next, an image capture device may be used to capture images of anathlete performing the athletic movements in step 504. The image capturedevice may include multiple cameras. In one embodiment the image capturedevice includes three cameras and is used to capture movement in threedimensions. Various embodiments may include cameras that capture lightin the visible and/or infrared spectrums.

It step 506 it is determined if data from one or more other sensors isavailable. Others sensors may include an accelerometer worn on the wristor embedded in or attached to footwear, a gyroscope, a heart ratemonitor, a compass, a location tracking device, such as a GPS device,pressure sensors inserted into footwear or any of the sensors describedabove that can be used to capture athletic movements and/or athleticperformance. The data received from the image capture device and one ormore sensors may be used to generate a human movement screen score. Whenonly data from the image capture device is available, in step 508 ahuman movement screen score is generated with data from the imagecapture device. When additional sensor data is available, in step 510 ahuman movement screen score is generated with data from the imagecapture device and data from more or more additional sensors. Inalternative embodiments a human movement screen score may be generatedwith only data from the image capture device even when other sensor datais available. For example, sensor data may be available but determinednot to be credible or below a threshold. In some embodiments the systemmay also selectively use data from any of the available sensors.

After a human movement screen score is generated, in step 512 apersonalized exercise program is generated based on a human movementscreen score. The personalized exercise program may be generated via adevice, such as a video game console, a server, or computer 102, thatincludes one or more processors. The human movement screen score mayreveal areas that can be improved and the personalized exercise programmay address those areas. FIG. 7 illustrates exemplary personalizedexercise program phases in accordance with an embodiment of theinvention. Column 702 lists exercises that may be used to generate humanmovement screen scores for various body movements. Columns 704 and 706show exemplary criteria that may be used to score each exercise. Twolevels are shown for illustration purposes only. Various embodiments mayuse three, four or more scoring levels. In one embodiment, four scoringlevels are used and the levels include (1) experienced pain during theexercise; (2) exercise was not functionally performed; (3) exerciseperformed acceptably; and (4) exercise performed well. Columns 708 a-708c shown exemplary exercises that may be part of a personalized trainingprogram. A personalized exercise program may include exercises thatstart at different phases based on the relevant human movement screenscore. For example, core stability may start at phase 1 and twist maystart at phase 2.

In alternative embodiments a user may also provide preference data thatis used to generate the personalized exercise program. The preferencedata may include time commitments, numbers of exercise sessions,preferred days to exercise, preferred exercises and goals. In oneembodiment a user may provide access to an electronic calendar, such asone stored on a website, that shows the user's availability to exerciseand the personal training system scans the calendar to determineavailability and time commitments. The personal training system may lookat historical calendar data to determine probable best times andavailable time commitments or future calendar data to determine actualavailability. The personal training system may also be configured toupdate the exercise program based on the user's actual availability. Forexample, a user may have an exercise session scheduled for Mondayevening and a scan of the user's calendar reveals that the user has anappointment Monday evening that makes exercising not practical. Thepersonal training system may modify the exercise program to reschedulethe exercise to another day. Other changes to the exercise program mayalso be made to keep the user on track to reach goals. The personaltraining system may even add calendar events to the user's calendar.

Users may exercise at locations away from the personal training system.Exercise data may be captured by a variety of sensors, such asaccelerometers worn on the wrist or other body parts. Accelerometers mayalso be embedded in or attached to footwear or articles of clothing.Other sensors that may be used to capture exercise data away from thepersonal training system include gyroscopes, location tracking devices,such as a GPS device, heart rate monitors, pressure sensor systemsplaced in footwear and any of the sensors described above. The capturedexercise data may be provided to the personal training system via anetwork connection or hardware port, such as a USB port. Returning toFIG. 5, in step 514 it is determined whether exercise data has beencaptured by a sensor while the user was exercising away from thepersonal training system. Step 514 may include determining that GPS datathat was captured with a mobile phone while a user ran is available. Ifno sensor data is available, the process ends in step 516. One skilledin the art will appreciate that the method shown in FIG. 5 is merelyexemplary and may be modified to include other steps and various loops.For example, instead of ending in step 516, the process may wait apredetermined time and repeat step 514.

When sensor data is received, in step 518, the personal training systemmay modify the personalized exercise program based on the exercise datacaptured by the sensor. Modifications may include one or more changes tothe types of exercises or durations of exercises. For example, if thesensor data indicates that the user recently ran, the next session ofthe personalized exercise program may be modified to not exercise theprimary muscle groups involved in running. Other exemplary modificationsinclude reducing the duration or eliminating an exercise session.

B. Illustrative Embodiments

When a user begins an exercise program, the computer 102 may prompt theuser to perform a series of exercises in front of an image capturingdevice. The computer 102 may process the images and assign a scoreindicating how well the user was able to complete each of the exercisesto establish a baseline physical fitness level. When performing anexercise, the computer 102 may instruct the user to position him orherself at a certain distance and orientation relative to an imagecapturing device. The computer 102 may process each image to identifydifferent parts of the user's body, such as, for example, their head,shoulders, arms, elbows, hands, wrists, torso, hips, knees, ankles,feet, or other body parts. The computer 102 may generate a set of dataidentifying a location of various body parts within the image. Thecomputer 102 may process the data set to determine a relationshipbetween certain body parts. These relationships may include an angle ofone body part relative to another. For example, when the user is doing asquat, the computer 102 may compare the angle of a user's torso with anangle of the user's thigh. In another example, the computer 102 maycompare a location of a user's shoulder relative to their elbow and handduring a push up.

The computer 102 may compare the data set to a desired data set for eachexercise to monitor the user's form while performing an exercise. Thedesired data set may include multiple comparison points throughout anexercise. For example, a push up may be divided into four events: (1)the lowest point where the user's chest is nearest to the ground andtheir arms are bent; (2) a highest point where the user's chest isfarthest from the ground and their arms are straightened; (3) an upwardevent where the user transitions form the lowest point to the highestpoint; and (4) a downward event where the user transitions form thehighest point to the lowest point. The desired data set may specifycomparison points for each of these events focusing on certain bodyparts. For example, at each comparison point during a pushup, thecomputer 102 may monitor the spacing of the user's hands, thestraightness of the user's back, a location of the user's head relativeto their torso, the spacing of the user's feet relative to one another,or other aspects. The desired data set may specify desired locations foreach body part being monitored during comparison points within anexercise, as well as permitted variations from the desired locations. Ifthe user's body part varies beyond what is permitted, the computer 102may provide the user with feedback identifying the body part and acorrection to the user's form (e.g., back is arched, and not straight,during a pushup).

The computer 102 may also score the user's performance of an exercise.Scoring may be based on the user's form, how quickly the user was ableto complete the exercise (e.g., 20 pushups in 60 seconds), a number ofrepetitions the user completed, the amount of weight the user usedduring an exercise, or other exercise metrics. In additional toprocessing the images, the computer 102 may receive data from othersources. For example, the user may run a predetermined distance asmeasured by a sensor attached to the user (e.g., sensor in a shoe) orglobal positioning system (GPS) device and may upload the data to thecomputer 102. Based on the images and/or data acquired by other sensors,the computer 102 may determine areas of weakness for the user (e.g.,inability to do a pull up) and design a workout to help the user improvetheir overall fitness level. Score may be a function of a particulardrill and may be focused on position, accuracy and correct execution.Scoring may also be based on time and/or a number sets or repetitionswithin a set time period.

FIG. 8 illustrates an example flow diagram for a user's initialinteraction to determine a user's baseline physical fitness level. Inthis example, the system may scan the user and prompt the user to signup and purchase automated training. The system 300 may obtaininformation from the user about weight, gender, and age, and create aninitial baseline physical fitness level. The system may lead the userthrough an initial set of drills, and set a participation goal.

After completing the baseline physical fitness level for the user, thecomputer 102 may then create an initial personalized program. Theinitial personalized program may be a function of user input, staticassessment of the user, and a human movement screen. User input mayinclude a user's time commitment, as well as number of exercise sessionsper week and one or more goals. The status assessment may provide theuser with information and coaching on exercises. The human movementscreen score may be assessments of the user's performance of theexercise drills.

FIG. 9 illustrates an example of creating a personalized exerciseprogram. The personalized program may be a function of human movementscreen scores, the number of exercise sessions per week the userdesires, and the goal of the user (e.g., total body fitness, run amarathon, lose weight, etc.). Goals may also include “get strong”, “getlean” and/or “get toned.” Other factors that may be considered include auser's fitness profile that may consider a current assessment of auser's fitness level as well as user preferences. The user may alsospecify multiple goals, including to be fitter, stronger, faster,centered, etc. The user may specify a fitness level, such as, forexample, beginner, intermediate, advanced. The computer 102 may evaluatethe user's fitness level over time to confirm the user input fitnesslevel or to adjust exercises based on measured performance rather thanthe user specified fitness level. The user may also specify a desiredlength of their program, such as 1 week, 2 weeks, 4 weeks or a customlength.

To obtain these inputs, the computer 102 may present a graphical userinterface (GUI) on the display 302 prompting the user to start a newprogram and to provide input for the initial personalized program, asshown in FIGS. 10-13. In FIG. 10, the graphical user interface maypresent the user with options to select a trainer (e.g., tabs for Joshor Lisa), to start a new program, or to do a drop-in session. Inresponse to selecting to start a new program, the graphical userinterface may prompt the user to input user desired workout selections,as depicted in FIG. 11. The user may, for example, select a programlength and a number of sessions per week. The GUI may then present theuser with a total number of workout sessions. The GUI may also presentthe user with options to buddy up or to join a group where a user may benetworked (e.g., via the Internet) with at least one other user toexercise at the same time. When a drop in session is selected, drillsfor a single session may be selected in a manner that appears random tousers, i.e. pseudo random. The selection may be based on one or moregoals of the user, such as strength and cardio goals. The selection mayalso be based on time or performance of the user. The system may selectdrills for as long as the user wishes to exercise.

FIG. 12 shows a scroll bar in the GUI where a user may select a desirednumber of times to exercise per week. In FIG. 13, the GUI permits theuser to input reminders so that an email or text message may be sent toa device (e.g., mobile phone) to remind the user about an upcomingworkout session. The reminder may include a time and date of one or moreupcoming workout sessions.

FIG. 14 illustrates an example baseline physical fitness levelassessment determined using human movement screen scoring and tempo. Thecomputer 102 may prompt the user to perform one or more exercise drills,and determine a score each of the assessment exercises using humanmovement screen scoring as well as the tempo of the user completing theexercise drills. The human movement screen scoring may range from 0 to3, and the tempo may have categories of slow, moderate, normal, andexplosive.

The drills may be used for assessing user performance relative toperformance pillars and body movement categories, as depicted in FIG.15. The performance pillars may be assessments designed to analyze auser's strength, power, speed & agility, energy systems, mobility, andregeneration. Body movement drill categories may include assessments ofcore stability, twist, squat, pull, single-leg balance, push, bend, andlunge.

FIG. 16 illustrates an example relationship between body movementcategories and human movement screen exercises. Human movement screenexercises may include rotary stability, overhead squat, shoulderstability, hurdle step, push up, active leg raise, and in-line lunge.Rotary stability may correspond to the core stability and twist bodymovement categories, overhead squat may correspond to the squat bodymovement category, shoulder stability may correspond to the pull bodymovement category, hurdle step may correspond to the single-leg balancebody movement category, push up may correspond to the push body movementcategory, active leg raise may correspond to the bend body movementcategory, and in-line lunge may correspond to the lunge body movementcategory.

The computer 102 may instruct the user to perform the same drill atvarious tempos, as described in FIG. 17. The tempo of the drill canaffect which performance pillar is being assessed. In a squat, forexample, the computer 102 may assess a user's strength in a slow tempoand a user's power in an explosive tempo. FIG. 18 illustrates fourdifferent tempo categories including slow, moderate, normal, andexplosive. Slow may involve the user moving down in an exercise over twoseconds, holding for one second, and moving up in the next two seconds.

Based on the human movement screen scoring, the computer 102 maygenerate a workout structure for the user, an example of which isdepicted in FIG. 18. The computer 102 may consider the number ofexercise sessions the user is willing to do per week in combination withthe human movement screen score to generate a workout program. Theworkouts may focus on one of three activities: an A strength workout, aB cardio and metabolic workout, and a C regeneration workout. If a useris only willing to workout once per week, the computer 102 may assign astrength workout (i.e., 1×A). If the user is willing to workout morethan once per week, the computer 102 may consider the human movementscreen score for the user. Generally, the computer 102 may differentiatebetween scores 14 and above and scores 13 and below. For human movementscreen scores 14 and above, the computer 102 may assign one strengthworkout, one cardio and metabolic workout per week, and no regenerationworkouts. For human movement screen scores 13 and below, the computer102 may assign two strength workouts, no cardio and metabolic workoutper week, and no regeneration workouts. The computer 102 may alsostructure workouts for users desiring to workout 3 or more times perweek, as shown in FIG. 19. Alternative embodiments of the invention manyinclude other workout structures that include different types ofworkouts and numbers of sessions.

FIG. 19 illustrates an example flow diagram for setting goals andencouraging commitment from the user. The computer 102 may present theuser with a result of the assessment and comments, and prompt the userto select 1 or more goals (e.g., lose weight, gain strength, etc.).Based on the user's selection and the baseline physical fitness level,the computer 102 may recommend a workout plan. The computer 102 may alsopermit the user to record a statement of their goal. Goals may betailored to performing certain events and may include training sessionsdeveloped for or by professional athletes. For example, the computer 102may load a training session pack developed for or by a pro athlete(e.g., ‘Paula Radcliffe's marathon training’) for real life events.

FIG. 20 illustrates an example workout plan. In this example, theworkout plan is for a six month exercise program designed to improve theuser's human movement screen score over time. Other workout plans couldhave different durations, such as one month. In some embodiments usersare not presented with an entire workout plan when it is created. Theleftmost column may indicate the body movements that correspond to thehuman movement screen scoring areas, and the remaining columns maycorrespond to month long programs specifying a drill in each of the bodymovement categories. Each of phases 1-6 may be a month long program, andthe score 1 and 2 columns may correspond to month long programs ofremedial exercises for users having human movement screen scores lessthen 3 in a particular body movement category. In phase 6, for example,the program includes a renegade row exercise in the core stabilitymovement category, a seated Russian twist exercise in the twist movementcategory, and so forth. The user may perform the same exercise drillsduring each exercise session over the month, but the intensity andduration of each exercise drill may change over the month according to a4 week routine. The computer 102 may also permit the user to swap onedrill for an equivalent drill.

If a user receives a human movement screen score of 3 in all categories,the computer 102 may prompt the user to performance exercises shown inthe month 1 column. If the user receives a human movement screen scoreof 1 or 2 in any body movement category, the computer 102 may prompt theuser to perform the body movement in the score 1 or score 2 columns forthat category. For example, if the user receives a score of 1 in thepull category, the computer 102 may prompt the user to perform the reachroll'n lift exercise in month 1, the Lying T's in month 2, and so forthalong that row and the six month program would end at the bent over rowexercise from the month 4 column.

In another example, the workout plan may include a baseline workout andsix month long programs, examples of which are depicted in FIGS. 21-34.FIGS. 21-24 describe Workout A, which includes exercises focusing ondeveloping a user's strength and power. FIGS. 25-32 describe Workout B,which includes metabolic focus with exercises to develop a user's speed,agility, and power. FIGS. 33-34 describe Workout C, which includesregeneration exercises such as stretching exercises. Workout A, forexample, may be the priority workout if a user only works out once perweek, but other workouts may be prioritized as well.

With reference to FIG. 22, the Workout A program for months 1-2 mayinclude an exercise list, a relationship between workout phases andhuman movement screen, and phase details. The program may include adynamic warm-up, followed by exercises in each of the body movementcategories. After completed the listed exercises, if the user has ahuman movement screen score of 14 or more, the program may include ametabolic challenge where the user is prompted to perform an exerciseattempting to physically challenge the user (e.g., run as fast as youcan, do repetitions until muscle failure, etc.). Thereafter, the programmay include regeneration exercises (e.g., stretching).

With reference to FIG. 26, the workout plan may specify a number ofsets, an amount of time of exercise, and an amount of time of rest. Forexample, in month 1, Workout B specifies 2-3 sets per exercise, wherethe user works for 20 seconds followed by 20 seconds of rest.

Each month long program over the six month program may be divided into 4phases each lasting a week, an example of which is depicted in FIG. 35.Week 1 may be the “introduction week” to introduce the user to aninstructional technique and to obtain a baseline physical fitness level.Week 2 may be the “base week” and may involve the user improving theirtechnique as well as increasing workout intensity. Week 3 may be the“overload week” and may involve adding more load (e.g., weight) to aworking program and increasing intensity. Week 4 may be the “challengeweek” and may involve pushing a user to their maximum. Other 4 weekprogressions may also be used. Generally, the human body adapts every4-6 weeks. Some users may adapt at different intervals and the programmay be structure to account for these differences. Some programs mayalso include shorter or longer progressions and the progressions may bedetermined by analyzing the performance of a user. The computer 102prompts the user to learn proper technique which leads to progression.Challenges are increased over time by adding repetitions and equipment.As the user conquers a workout, they are given a new routine to learn,providing an intrinsic reward. The computer 102 attempts to learn auser's most effective workout, and reassess a user's performance every 4weeks.

FIG. 36 illustrates a flow diagram for leading a user through a workoutsession. The computer 102 may prompt the user to begin a workoutsession, and ask how long the user has to work out, as seen in FIG. 37.The computer 102 may then provide a summary of the exercise drills theuser is going to perform. The computer 102 may provide the how and thewhy of workouts to help the user get into the mindset of a competitiveathlete. Competitive athletes may include professional athletes, collegeathletes, personal trainers, community leaderboard participants andothers. For example, the drills may relate to corrective/core exercises,strength/power exercises, energize/metabolic exercises,regenerate/stretch exercises. The computer 102 may lead the user througha warm up session (as seen in FIG. 38). The warm up session may be adynamic warm-up designed to warm up the user's muscles in each of thebody movement categories. The computer 102 may then provide ademonstration of a first drill (as seen in FIG. 39). The user may thenperform the drill in front of the image capturing device 304 as thecomputer 102 process images of the user. The computer 102 may cause adisplay to display an image of the user performing the drill (see FIG.40). The computer 102 may also provide encouragement to the user to keepgoing (e.g., just 5 more repetitions) as well as feedback. Encouragementmay be given after detecting a predetermined number of repetitions(e.g., every 3-5 repetitions), in response to detecting a repetitionrate decreases below a level, or other metric.

The feedback may allow the user to compete against their own benchmarksto see improvement in real-time and over time. FIG. 41, for example,illustrates a comparison of a user's form versus desired form. Inanother example, FIG. 42 illustrates an image of the user exercisingwith added straight lines to show proper back and hip posture during adeep squat. In a further example, FIGS. 43A-B illustrates graphical userinterfaces providing the user with feedback on their form (i.e.,Correction needed: straighten knees), and removes the correctivefeedback when the user's form improves. Once one drill is completed, thecomputer 102 may prompt the user to move onto the next drill. FIG. 44,for instance, illustrates a graphical user interface informing the userof the next training category during the workout session.

As shown by the examples in FIG. 45, the system may use data points todetermine feedback and motivation to provide to a user during a workoutsession. The system may also revise a workout session based on theamount of time a user can commit to a workout, as described withreference to FIGS. 46-49. For example, a workout may require 60 minutes,but a user may only have 20 minutes (see FIGS. 46-47). The system mayscale down the workout session based on the amount of time a user has(see FIG. 49). Adjustments may include altering an amount of warm uptime, a number of sets, a number of repetitions, substitution ofexercises, and the like.

The system may also account for missed workout session. If a user isable to make at least one workout session per week, the computer 102 maycontinue with the scheduled workout program (see, for example, FIG. 20).If the user misses an entire week, the computer 102 may start the userto perform the next workout where they left off. If the user has missedtwo or more weeks, the computer 102 may have the user repeat the lastweek they attended. The computer 102 may also send a message to a user'sdevice (e.g., desktop computer, smart phone, laptop computer, etc.)informing of the missed workout, how many workouts have been missed, andhow the missed workout has affected reaching the user's goals. Thecomputer 102 may also include in the message a prompt to reschedule themissed workout. In some embodiments users may skip workouts.

FIG. 50 illustrates a flow diagram for providing a user withpost-workout information. Upon completion of a workout, the computer 102may inform the user that the workout session is complete and may causethe trainer avatar to extend a fist for a virtual fist bump or othercongratulatory movement (see FIG. 52). The computer 102 may inform theuser of their workout performance and an amount of points associatedwith the workout (see FIG. 52-53). The computer 102 may also prompt theuser to continue exercising (see FIG. 54). The computer 102 may alsoprovide the user with feedback on their form, and may indicate a numberof repetitions in the preferred, red, and green zones, discussed above,for each of the exercise drills.

The computer 102 may also calculate a fatigue index indicating how wellthe user maintained good form over the duration of a drill. For example,the fatigue index may indicate that the user was in the preferred zonefor the first 4 repetitions, in the good zone for the next 5repetitions, and in the red zone for the last repetition.

If the user trains hard during a session, the computer 102 may associatea greater number of points and unlock new workouts. Upon reaching pointmilestones, the user may unlock workouts and online challenges, or theuser may purchase these items online through a gaming console. Otherincentives may include obtaining certification as a trainer uponreaching certain fitness milestones. The user may also purchase productsfrom a particular clothing or footwear supplier to increase rewards. Forexample, a product may have an embedded barcodes or other informationthat a user may scan or otherwise input to the computer 102 to unlocknew training sessions (e.g., a session about stretching for a run). Insome embodiments the purchase of certain products may allow a user tounlock new workouts. The new workouts may be related to or use thepurchased products.

A display device may present a graphical user interface of apost-workout-dashboard permitting a user to review training data withanalysis to view progress and improve future sessions. The user may alsoelect to post their workout online via social networking (e.g., via asocial networking website) or otherwise share their workout sessions.Users may post comments and provide recommendations when reviewingworkouts of other users. Users may also post messages to providemotivation to other users. The computer 102 may also post information toa social network when a user improves their fitness level (e.g., Bobimproved his fitness level from intermediate to advanced). The computer102 may have a dynamic recommendation engine that suggests new workoutsbased on profile and previous training successes. Trainers may alsorecommend different types of engagements such as joining a challenge orgoing head to head with a friend. The computer 102 may then suggest atime and date for a next workout session.

FIG. 55 illustrates a flow diagram of a drop-in workout session andFIGS. 56-59 illustrate corresponding graphical user interfaces. Adrop-in workout session may be an extra workout session in addition tothe ones a user has scheduled for a particular week. A drop-in sessionmay also be where a user opts to do a different workout than the one thescheduled for the user. The computer 102 may adjust future workoutsbased on the drop-in session. Adjustments may include adding or removinga future workout of a particular type (e.g., Drop-in session is an Aworkout, so replace a future A workout with a B workout). If a user isavoiding a particular exercise, the computer 102 may identify one ormore equivalent exercises and may adjust future workouts to exclude theparticular exercise. Other adjustments may also be made.

To initiate a drop-in session, the user may select a drop-in workoutsession tab of a graphical user interface (see FIG. 56). The computer102 may ask how long the user has to work out (see FIG. 57) and whattype of session the user wants to do, examples of which may include afully body workout, a strength workout, an endurance workout, a mobilityworkout, or a balance workout (see FIG. 58). The computer 102 may thenperform static postural analysis and/or a body scan. The computer 102may then provide a summary of the exercise drills the user is going toperform. For example, the drills may relate to corrective/coreexercises, strength/power exercises, energize/metabolic exercises,regenerate/stretch exercises. The computer 102 may lead the user througha warm up session, and then proceed to a first drill (see FIG. 59). Adisplay device may present a demonstration of the drill. The user maythen perform the drill in front of the image capturing device as thecomputer 102 process images of the user. The computer 102 may alsoprovide encouragement to the user to keep going (e.g., just 5 morerepetitions). The computer 102 then presents feedback to the user. Onceone drill is completed, the computer 102 may prompt the user to moveonto the next drill. After completion of the last drill, the computer102 may then update a user's points and provide them with a post-workoutsummary.

A challenge session may be where a user competes against a ghost oftheir previous workout or another user. For example, the computer 102may store video of a user performing a set of exercises, as well asperformance metrics. The display may present the video of the user wherethe user appears translucent, and hence is denoted as a ghost. Thedisplay may overlay video recorded by the image capturing device forcomparison with the ghost. The computer 102 may provide a demonstrationof the challenge, and the user may perform the challenge. Uponcompletion of the challenge, the computer 102 may display the challengeresults.

The user may also create their own challenges and workout sessions formore focused training or sharing with a social network. The user mayreceive points, money, or other incentives based on a number of otherusers who download a user created workout session. The user may alsocause the computer 102 to request ghost workouts from friends or pros toaid or compare.

Challenges may also be against multiple players at a single location(e.g., house), or via a network. FIG. 60 illustrates an exemplarychallenge drill. The computer 102 may identify other users havingsimilar fitness levels or users may challenge other users. Multipleplayers may simultaneously participate in a workout session at the samelocation, or may sequentially participate where a ghost of a player whocompleted a session is displayed onscreen competing against a laterplayer. Also, the computer 102 may join an online challenge where a usermay compete against another player who is also online. The onlinechallenge may permit competitions with multiple other players.Competitions may be organized by age group, fitness level, invitationonly, achieving a certain point levels, or in other manners. A ghost ofthe leader may be presented by the displays of all other challengers.The computer 102 may also cause a display to present a leader boardshowing how a user compares to other participants. Performance data,such as personal bests, may be communicated graphically and throughaudio devices.

CONCLUSION

Aspects of the embodiments have been described in terms of illustrativeembodiments thereof. Numerous other embodiments, modifications andvariations within the scope and spirit of the appended claims will occurto persons of ordinary skill in the art from a review of thisdisclosure. For example, one of ordinary skill in the art willappreciate that the steps illustrated in the illustrative figures may beperformed in other than the recited order, and that one or more stepsillustrated may be optional in accordance with aspects of theembodiments.

What is claimed is:
 1. A computer implemented method comprising: (a)capturing, with a wrist-worn sensor, motion parameter data of a user,wherein at least a first portion of the motion parameter data iscaptured as a result of the user performing an instructed athleticmovement; (b) generating at a processor, one or more human movementscreen scores based on the at least a first portion of the motionparameter data of the user performing the instructed athletic movement;(c) generating, by the processor, a personalized exercise program thatidentifies a body area of the user for improvement based on the one ormore human movement screen scores; and (d) modifying, by the processor,the personalized exercise program based on a probable availability ofthe user, calculated by the at least one processor by analyzinghistorical calendar data of the user.
 2. The computer implemented methodof claim 1, wherein (a) further comprises capturing, with an imagecapture device, images of the user performing the instructed athleticmovement.
 3. The computer implemented method of claim 1, wherein (b)comprises generating, at a processor, a human movement screen scorebased on the wrist-worn sensor and a second sensor.
 4. The computerimplemented method of claim 1, wherein the wrist-worn sensor, comprisesan accelerometer.
 5. The computer implemented method of claim 1, wherein(a) further comprises capturing motion parameters with a footwear-wornaccelerometer.
 6. The computer implemented method of claim 1 wherein thewrist-worn sensor comprises an orientation determining sensor. 7.computer implemented method of claim 1, wherein generating thepersonalized exercise program is based on the human movement screenscore and an input of the user.
 8. The computer implemented method ofclaim 7, wherein the input of the user comprises a time commitment. 9.The computer implemented method of claim 7, wherein the input of theuser comprises a number of exercise sessions in a predetermined timeperiod.
 10. The computer implemented method of claim 2, wherein theimage capture device comprises a plurality of cameras.
 11. The computerimplemented method of claim 10, wherein the image capture devicecomprises an infrared camera.
 12. The computer implemented method ofclaim 1, wherein (b) comprises evaluating a form of the user byidentifying locations of body parts of the user at different times. 13.The computer implemented method of claim 1, wherein (d) comprisesreducing or eliminating an exercise from the personalized exerciseprogram.
 14. The computer implemented method of claim 1, wherein thewrist-worn sensor comprises a display.
 15. An apparatus configured to beworn on an appendage of a user, comprising: at least one processor; adisplay device; a sensor device; a non-transitory computer-readablemedium comprising computer-executable instructions that when executed bythe at least one processor cause the at least one processor to: capture,from the sensor device, motion parameter data, wherein at least a firstportion of the motion parameter data is captured as a result of the userperforming an instructed athletic movement; generate, by the least oneprocessor, one or more human movement screen scores based on the atleast a first portion of the motion parameter data of the userperforming the instructed athletic movement; generate, by the at leastone processor, a personalized exercise program that identifies a bodyarea of the user for improvement based on the one or more human movementscreen scores; and modify, at the at least one processor, thepersonalized exercise program based on a probable availability of theuser, calculated by the at least one processor by analyzing historicalcalendar data of the user.
 16. The apparatus of claim 15, wherein thecapturing comprises obtaining accelerometer data from an accelerometerlocated on the apparatus.
 17. The apparatus of claim 16, wherein theaccelerometer data comprises data from a plurality of axes.
 18. Theapparatus of claim 16, wherein the computer-readable medium furthercomprises computer-executable instructions that when executed by the atleast one processor cause the at least one processor t: collect motionparameters of the user from a footwear-worn accelerometer; and whereingenerating the one or more human movement screen score is based upon atleast data obtained from the footwear-worn accelerometer and the motionparameters captured from the sensor device.
 19. The apparatus of claim16, wherein the sensor device comprises a gyroscope.
 20. Anon-transitory computer-readable medium comprising computer-executableinstructions that when executed cause a system to perform the stepscomprising: capturing, with a body-worn sensor, motion parameter data ofa user, wherein at least a first portion of the motion parameter data iscaptured as a result of the user performing an instructed athleticmovement; generating, with at least one processor, one or more humanmovement screen scores based on the at least a first portion of motionparameter data of the user performing the instructed athletic movement;generating, at the at least one processor, a personalized exerciseprogram that identifies a body area of the user for improvement based onthe one or more human movement screen scores; and modifying, with the atleast one processor, the personalized exercise program based on aprobable availability of the user, calculated by the at least oneprocessor by analyzing historical calendar data of the user.